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(54) A method and a device for providing improved speech intelligibility 



(57) The invention relates to a method for reduction 
of noise in an audio signal containing noise and a target 
signal, the method comprising, providing at least two in- 
put signals; processing the input signals by means of an 
independent component analysis, hereby determining 



statistical dependencies of signal elements of the two 
input signals and determining whether statistical de- 
pendent signal elements form part of the target signal; 
outputting a part of the audio signal. The invention fur- 
ther relates to a device for use in reducing noise in an 
audio signal containing noise and a target signal. 
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Description 

BACKGROUND OF THE INVENTION 

[0001] The invention relates to a method for the re- s 
duction or elimination of an eventual noise contribution 
to an audio signal, which is picked up by sensor means. 
The invention further relates to a device for reduction or 
elimination of an eventual noise contribution to an audio 
signal, which is picked up by sensor means. 10 
[0002] The invention will for practical reasons be ex- 
plained in connection with a hearing aid. The invention 
is however not limited to this field as it may be imple- 
mented in other technical fields where an audio signal 
is picked up by sensor means. is 
[0003] Although modern hearing aids have come a 
long way in providing amplification well suited to the 
hearing impaired user, many hearing impaired people 
still have problems understanding speech in noise. The 
issue of improving the speech intelligibility by improving 20 
the ratio between the desired speech signal and the 
noise has already been addressed in many ways, most- 
ly based on directionality. 

[0004] As of the present day the commercially avail- 
able directional devices are either an acoustical two-port 25 
design as disclosed in US patent no. 5524056, an elec- 
trical combination of the outputs of two omni-directional 
microphones as disclosed in J. Malsano & W. Hettinger, 
"A method for electronically beam forming acoustical 
signals and acoustical sensorapparatus", European 30 
Patent EP 0 820 210 A2, or an electrical combination of 
several microphones into a single highly directional de- 
vice to be used physically externally to the hearing aid 
as disclosed in W. Soede, A.J. Berkhout & FA. Bilsen, 
1 993, "Development of a directional hearing instrument 35 
based on array technology", J. Acoust. Soc. Am. 94(2), 
p. 785-798. 

[0005] These previously known devices are thus 
characterised by a certain amount of directionality point- 
ing in the forward direction with respect to the user, and 40 
characterised by a time-invariant processing of the indi- 
vidual ingoing sensor signals. Although the use of direc- 
tionality to some extent gives improved speech intelligi- 
bility, the directionality is in many situations non-satis- 
factory and there is a requirement of further improving 45 
speech inteligibility 

[0006] Directionality is also used in a different group 
of proposed devices, which make use of adaptive noise 
cancelling principles as disclosed in B. Widrow, J. Glov- 
er, J. McCool, J. Kaunitz, C. Williams, R. Hern, J. Zeidler, so 
E. Dong & R. Goodlin, 1 975, "Adaptive noise cancelling: 
Principles and applications", IEEE Proceedings 63, p. 
1692-1716. Thus : a number of microphones, which may 
be mounted either in hearing aids at each ear of the user, 
on a headband or in a single hearing aid shell, are com- 5s 
bined to form estimates of the interfering noise from 
which the target signal is removed. A signal containing 
as much target signal as possible is also formed, and 



these signals are then used as inputs to an adaptive 
noise canceller. These devices work on the assumption 
that the target speech signal impinges from a certain 
predetermined direction, and are characterised by a di- 
rectionality and a processing of the individual ingoing 
sensor signals, which is adaptively varying with time. 
Further, these devices are characterised by the use of 
the adaptive noise canceller, as disclosed in P. M. Zurek, 
J.E.Greenberg&P.M. Peterson, 1 990, "Adaptive beam- 
forming for noise reduction". United States Patent 
4,956,867; RV.F Clough & N.A. Lobo, European Patent 
0084892; and J. Vanden Berghe & J. Wouters, 1998, 
"An adaptive noise canceller for hearing aids using two 
nearby microphones", J. Acoust. Soc. Am. 103(6), p 
3621-3626. 

[0007] Although the use of adaptive noise cancelling 
based on directionality to some extend gives improved 
speech intelligibility, the directionality is in many situa- 
tions non-satisfactory in this respect, as it is the case in 
connection with the use of directionality alone. 
[0008] Recently, several researchers have published 
a new principle, which is called independent component 
analysis (ICA): 

1. J. Herault & C. Jutten, "Space or Time adaptive 
signal processing by neural network models", Neu- 
ral Networks for Computing, AIP Conference Pro- 
ceedings 151, Snowbird, Utah, pp. 207-211, 1986. 

2. A.J Bell, United States Patent 5,706,402. 

3 A.J Bell & T.J. Sejnowski, "An information-max- 
imisation approach to blind separation and blind de- 
convolution", Technical Report no. INC-9501, Feb- 
ruary 1995, Institute for Neural Computation, 
UCSD, San Diego, CA 92093-0523. 

4. T.W. Lee, M. Girolami, A.J. Bell & T.J. Sejnowski, 
"A unifying information-theoretic framework for in- 
dependent component analysis", Computers & 
Mathematics with applications, 1998 in press. 

5. T.W. Lee, A.J. Bell & R. Orglmeister, "Blind source 
separation of real world signals", Proceedings IC- 
NN, USA, 1997. 

6. T.W. Lee, A.J. Bell & R. H. Lambert, "Blind sep- 
aration of delayed and convolved sources", Ad- 
vances in Neural Information Processing Systems 
9, 1997 MIT Press, Camvridge MA pp. 758-764. 

7. P. Smaragdis, 1997, "Efficient blind separation of 
convolved sound mixtures", IEEE Workshop on Ap- 
plications of Signal Processing to Audio and Acous- 
tics, Mohonk Mountain House, New Paltz, New 
York. 

8. K. Torkkola, "Blind separation o1 delayed sources 
based on information maximation", Proceedings of 
the IEEE international conference on acoustic, 
speech and signal processing, May 7-1 0 1 996 GA 
USA. 

9. K. Torkkola, "Blind separation of convolved ourc- 
es based on information maximization", IEEE work- 
shop on neural network for signal processing, Kyo- 
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to, Japan, Sept 4-6, 1996. 

10. J. F. Cardoso, "Equivariant adaptive source sep- 
aration", IEEE Transactions on Signal Processing 
44(12), 1996. 

11 .S. Amari, A. Cichocki, H. H. Yang, "A new learn- 
ing algorithm for blind signal separation", Advances 
in neural information Processing systems 8. MIT 
Press, 1996. 

[0009] The objective of ICA is to recover the underly- 
ing independent source signals given only sensor ob- 
servations that are linear mixtures of the original source 
signals. The only assumption of ICA is that the original 
source signals are statistically independent, otherwise 
the statistics of the source signals and the mixing of 
these into the sensor signals may be unknown. In con- 
trast to correlation-based transformations such as Prin- 
cipal Component Analysis (PCA, IT. Jolliffe, Principal 
Component Analysis, 1986, Springer Verlag), which 
decorrelates signals according to 2 nd -order statistics, 
ICA also reduces higher- order statistical dependencies, 
in terms of maximising joint output entropy, in order to 
extract statistically independent signal components. 
[001 0] I n the linear blind signal separation problem, N 
signals, 

S(') =[■*,('), ,*v(')F. 

are mixed so that an array of N sensors picks up a set 
of signals 



*(/) = [x, (/),...,*„ </)F. 

each of which has been mixed, delayed and filtered as 
follows 



N Ml 

*,(0 = ZZ« y ^('-A,-*) 

where D^are entries in a matrix of delays and a, ^ are the 
M- tap filter coefficients between the yth source and the 
Ah sensor. The problem is to invert this scrambling with- 
out knowledge of it, thus recovering the original signals 
s(t) given only the x(t) signals. Finding this inverse 
scrambling is a challenging task since no informations 
are provided about the mixing nor the signals (hence the 
term blind separation). The type of architecture chosen 
for inverting the scrambling is important and can be 
made in numerous ways. An accurate architecture for 
inverting a M-tap filter is an infinite impulse response 
(I IR) filter with M coefficients. However, MR filters are lim- 
ited to have poles inside the unit circle, which imply that 



a stable filter only exists for a minimum phase system. 
FIR filters may be used to approximate the inverse so- 
lution. Thus the inverse scrambling is performed accord- 
ing to 

5 

;=! ir=0 

10 

which has filters, w,y, and delays which supposedly 
reproduce, at the output u(f) , the original uncorrupted 
source signals, s(r) , apart from a scaling factor for each 
75 signal and a permutation of signals. 

[0011] Several algorithms have been proposed for the 
blind separation of linear mixtures. Bell and Sejnowski 
(3) proposed to learn the separating process by mini- 
mising the mutual information between components of 
20 y(f) = g(u(t)), where g is a non-linear function approxi- 
mating the cumulative probability density function of the 
sources. They showed that for positively kurtotic signals 
(like speech) minimising the mutual information be- 
tween components of y(f) is equal to maximising the en- 
25 tropy ol y(0, which can be written as 

//(y) = -E[ln(/^y))], 

30 

where fy(y) denotes the probability density function of y 
(0. Denoting the determinant of the Jacobian of the 
whole unmixing process by Lfl , f^y) can be written as 
f x (x)/\J\ (the Jacobian is a matrix with entries of dy/dxj). 
35 Maximising the entropy of the output leads to maximis- 
ing 

which in turn can be developed into a stochastic gradient 
ascent rule using instances of x(f) and y(f), instead of 
using the expectation. Thus 



AW oc (1 - 2y(/))x(/) r + [w 7 J" 1 

so 

where g(u) = 1/(1 + e" 47 ) is used to approximate the cdf. 
[0012] The algorithm can be made more efficient and 
independent of the conditioning of the mixing process 
(matrix) by using the so-called natural gradient instead 
55 of the absolute gradient, see Amari (11). 

[0013] One particular proposed application of ICA is 
within electroencephalographic (EEG) recording of 
scalp potentials in humans and related brain activity 
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measurements. 

[0014] The application of the ICAto hearing aids has 
also been mentioned in H. Sahlin, "Blind signal separa- 
tion by second order statistics", Ph.D. thesis, Chalmers 
University of Technology, Technical Report no. 345, 
Sweden, 1998, but it has so far never been suggested 
how the implementation of this technique could be real- 
ised in connection with audio systems in order to im- 
prove speech intelligibility. 

[0015] Based on this prior art the objective of the 
present invention is to provide a method and a device 
for reducing noise in an audio signal comprising both 
noise and target signal, which method and device has 
an increased functionality and reliability compared with 
the prior art within the audio field of technology 

SUMMARY OF THE INVENTION 

[0016] This is achieved by means of a method com- 
prising the steps of: 

providing at least two input signals, each having dif- 
ferent contents of target signal and noise; 
processing the two input signals; 
the processing comprising use of an independent 
component analysis or a similar technique based 
on the differences of the at least two input signals, 
hereby determining whether statistical dependent 
signal elements are present and removing at least 
part of unwanted signal elements; 
outputting a part of the audio signal. 

[0017] The target signal is defined as the signal com- 
ing from in front of the device performing the method, 
whereas other signals are considered as noise signals. 
In case of no specific well-defined source signal and 
cases laying outside the assumed set-up, the noise 
elimination will disappear meaning that the signal 
processing strategy will pass the input signals unaltered 
to the outputs. 

[0018] In a preferred embodiment the method com- 
prises at least two input signals, which are picked up at 
least at two mutually distanced locations Hereby one 
signal contains the target signal with a higher signal-to- 
noise ratio than the other input signal. In this case the 
sensor may be identical. 

[0019] In a further preferred embodiment the method 
comprises at least two input signals, which are based 
on differences in the directionality, preferably a direc- 
tional and an omni-directional sensor. Hereby it be- 
comes possible to determine the origin of the respective 
signal components based on the differences of the di- 
rectionality applied when sensing the two input signals. 
[0020] The different embodiments show that the dif- 
ferences in signal-to-noise ratio is based on the actual 
situation of use, which means that it is the mutual differ- 
ences in signal-to-noise ratio in relation to a desired tar- 
get signal, which is relevant, and not the signal-to-noise 



ratio of the sensor means itself. 

[0021] In a further preferred embodiment two or more 
output signals are produced and where a possibility ex- 
ists for switching between the two or more output signals 

5 or combinations of these. Alternatively an automatic 
switching between the two or more output signals ac- 
cording to a predetermined scheme is provided. Hereby 
it becomes possible to make a choice of the actual in- 
fluence of the separation method on the noise canceling 

10 in the actual situation or at least have a change accord- 
ing to the actual choice of the predetermined scheme, 
which may be adapted for switching at different listening 
environments. 

[0022] The objective of the invention is further 
15 achieved by means of a device comprising: 

at least two input channels; 

signal processing means in connection with the in- 
put channels, which provides input signals to the 
signal processing means; 

a receiver in connection with the signal processing 
means; 

the signal processing means being adapted to proc- 
ess the signals by means of an independent com- 
ponent analysis method or a similar method based 
on differences of signal-to-noise ratios of the input 
signals in relation to a desired target signal, the 
processing comprising determining whether statis- 
tical dependent signal elements are present and re- 
moving at least part of the unwanted signal ele- 
ments, thereby enhancing other parts of the audio 
signal. 

[0023] In a preferred embodiment the device compris- 
es two sensors, preferably microphones, having differ- 
ent signal-to-noise ratio (S/N-ratio). One of the sensors 
is chosen as the target sensor. Hereby it becomes pos- 
sible to separate the respective signal components 
based on the noise content of the further sensor. 
[0024] In a preferred embodiment the device compris- 
es a directional microphone and an omni-directional mi- 
crophone. Hereby the directional microphone will pref- 
erably contain the desired output signal based on the 
position of the user facing the desired audio signal 
source. 

[0025] In a preferred embodiment the two micro- 
phones are mutually distanced. Hereby it becomes pos- 
sible to determine the origin of the respective signal 
components based on a time delay in reception of the 
two input signals. This makes it possible to make a 
beamforming of the input signals hereby possibly add- 
ing directionality to at least one of the inputs. Other ways 
of beamforming may be used in this connection. 
[0026] In a preferred embodiment two or more output 
signals are produced and means are provided for 
switching between the two or more output signals or 
combinations of these. Alternatively means are provid- 
ed for automatic switching between the two or more out- 
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put signals according to a predetermined scheme. 
[0027] Due to the fact that most hearing impaired 
have a hearing disorder which makes it even more dif- 
ficult than for normal hearing persons to separate a tar- 
get signal from the noise, which is often present in a 5 
speech situation, the invention is particularly relevant in 
connection with the technical field of hearing aids. 
[0028] The invention therefor further relates to a hear- 
ing aid comprising: at least two microphones for audio 
signal input; signal processing means in connection with 
the microphones; an amplifier in connection with the sig- 
nal processing means; a receiver in connection with the 
amplifier for outputting a signal from the amplifier; the 
signal processing means being adapted to process the 
signals by means of an independent component analy- 
sis method or a similar method based on the input from 
the at least two microphones, the processing comprising 
determining whether statistical dependent signal ele- 
ments are present and removing at least part of the un- 
wanted signal elements, thereby enhancing other parts 
of the audio signal. 

[0029] The hearing aid according to the invention may 
further comprise the features set forth above, either sep- 
arate or in combination. 

[0030] Other fields of relevant use of the invention 
may be telecommunication or audio systems. In such 
systems the input and output may be connected to an- 
tennas or similar transmission and receiving means or 
may comprise microphones as input means as in the 
case of a hearing aid. Other elements of such systems 
may be standard elements, as these are not influenced 
by the signal processing according to the invention. 
[0031] The invention will be described more detailed 
with reference to the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0032] 

Fig. 1 is a diagram showing the principles of the in- 
vention; 

Fig. 2 is a schematic diagram showing the principles 
of an implemented version of the invention; 

Fig. 3 is a schematic diagram showing the principles 
of an implemented version of the invention; 

Fig. 4 is a schematic diagram showing the imple- 
mented version of the invention as shown in 
fig. 2 further implemented in a hearing aid. 

DESCRIPTION OF THE PREFERRED EMBODIMENT 

[0033] The fundamental principle of the invention is 
schematically shown in fig. 1 . The invention is basically 
a system, e.g. a hearing aid, with two or more sensors 
and a calculation unit. The calculation unit carries out 
the separation of the target and noise signals, by using 
the independence of the mixed signals according to ICA 
or a similar method comprising the basics of the ICA. 



The sensors are arranged so that one is positioned to 
receive sound primarily from a target direction in front, 
whereas the others have arbitrary characteristics that 
do not specifically favour the target direction. Hereby, it 
is possible to use the technique of independent compo- 
nent analysis to separate the desired signal, which im- 
pinges from the target direction, from the disturbing 
noise signals : which impinge from any other directions. 
[0034] To illustrate the invention, an example is given 
of a system implementing signal processing as de- 
scribed above. Fig. 2 schematically shows the signal 
processing system. The system comprises a directional 
and an omni-directional microphone, and a digital signal 
processing unit implementing the signal separation al- 
gorithm. Using the directional microphone gives the tar- 
get direction from in front of the user, whereas the omni- 
directional microphone gives a signal equally represent- 
ing all signals around the head of the user. 
[0035] A particularly important property of the inde- 
pendent component analysis is that it separates con- 
volved and delayed source signals, where each inde- 
pendent source signal is defined as a signal which ap- 
pears in the same way within each mixing process. An- 
other important characteristic about the independent 
component analysis is that knowledge about the ratio of 
the source signals within the mixed signals can be used 
for classifying the separated signals. If for instance one 
source signal appears with a significantly better signal 
to noise ratio in one of the sensor signals, this informa- 
tion can be used to ensure that this source signal always 
will appear in a fixed output. Within the present invention 
these two characteristics combined with an appropriate 
placement of at least two sensors are exploited to elim- 
inate signals not coming from in front of the user of the 
device. 

[0036] From fig. 3 an embodiment appears, which 
comprises the features of the embodiment of fig. 2, but 
where the signal processor produces two output signals. 
By means of switching means one of the two output sig- 
nals may be selected for further processing, e.g. ampli- 
fication, or for output. 

[0037] From fig. 4 an embodiment appears as a hear- 
ing aid according to the invention. The essential com- 
ponents of the hearing aid comprise two microphones, 
preferably a directional microphone and an omni-direc- 
tional microphone, and an A/D converter connected to 
each of the microphones. The A/D converters are con- 
nected to a digital signal processor, which is adapted to 
perform the ICA method on the incoming signals. The 
signal from the signal processor is then lead to an am- 
plifier and from this through a D/A converter to a receiver 
for performing the output of the processed signal. The 
devices of the figs, is in a usual manner powered by 
means of usual power sources, such as batteries. 



75 



20 



25 



30 



35 



40 



45 



50 



5 



BNSDOCIO: <EP 1018854A1_I_> 



EP1 018 854 A1 



10 



Claims 



A method for reduction of noise in an audio signal 
containing noise and a target signal, the method 
comprising: s 

providing at least two input signals, each having 
different contents of the target signal and the 
noise ; hereby providing different input signals; 
processing the input signals by means of an in- 10 
dependent component analysis based on the 
differences of the content of the at least two in- 
put signals, hereby determining whether statis- 
tical dependent signal elements are present 
and removing at least part of the unwanted sig- fS 
nai elements; 

outputting a part of the audio signal. 



different input signals for the respective input chan- 
nels. 

7. A device according to claim 5 or 6, wherein the de- 
vice comprises at least a directional microphone 
and an omni-directional microphone. 

8. A device according to claim 5, 6 or 7, wherein two 
or more output signals are produced and where 
means are provided for switching between the two 
or more output signals or combinations of these. 

9. A method according to claim 5, 6 or 7, wherein two 
or more output signals are produced and where au- 
tomatic switching means are provided for switching 
between the two or more output signals according 
to a predetermined scheme. 



2. A method according to claim 1 , wherein the at least 
two input signals are picked up at least at two mu- 
tually distanced locations, 

3. A method according to claim 1 or 2, wherein two or 
more output signals are produced and where a pos- 
sibility exists for switching between the two or more 
output signals or combinations of these. 

4. A method according to any of the claims 1 -3, where- 
in two or more output signals are produced and 
where an automatic switching between the two or 
more output signals according to a predetermined 
scheme is provided. 

5. A device for use in reducing noise in an audio signal 
containing noise and a target signal, the device 
comprising: 

at least two input channels; 

signal processing means in connection with the 

input channels, which provides input signals to 

the signal processing means; 

a receiver in connection with the signal 

processing means; 

the signal processing means being adapted to 
process the signals by means of an independ- 
ent component analysis method based on dif- 
ferences of signal-to-noise ratios of the inputs 
signals in relation to a desired target signal the 
processing comprising determining whether 
statistical dependent signal elements are 
present and removing at least part of the un- 
wanted signal elements, thereby enhancing 
other parts of the audio signal. 

6. A device according to claim 5, wherein the device 
comprises at least two microphones having a mu- 
tually different signal-to-noise ratio in relation to a 
desired target signal, hereby being able to provide 



10. A hearing aid comprising at least two microphones 
20 each having a different signal-to-noise ratio in rela- 
tion to a desired target signal; signal processing 
means in connection with the at least two micro- 
phones; an amplifier in connection with the signal 
processing means; a receiver in connection with the 

2s amplifier for outputting a signal from the amplifier; 

the signal processing means being adapted to proc- 
ess the signals by means of an independent com- 
ponent analysis method based on the input from the 
two microphones having a mutually different signal- 
so to-noise ratio in relation to a desired target signal, 
the processing comprising determining whether 
statistical dependent signal elements are present 
and removing at least part of the unwanted signal 
elements, thereby enhancing other parts of the au- 
35 dio signal. 

11. A hearing aid according to claim 12, wherein the 
hearing aid comprises a directional microphone and 
an omni-directional microphone. 
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